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differential  equations,  not  necessarily  self-adjoint,  with 
both  natural  and  Dirichlet  boundary  conditions,  and  also  give 
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stochastic  control  problem.  This  latter  problem  is  solved  and 
from  it  a numerical  scheme  arises  naturally.  This  method 
appears  to  have  applications  in  solving  other  problems. 
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1.  Introduction 


In  this  paper  we  give  a new  characterization  of  the  principal 
eigenvalue  for  the  eigenvalue  equation 

(l)  -Vo  +CU  = Xpu  in  O 


with  the  natural  boundary  condition  u^an  = 0 on  "bO*  Above  a is 
a positive  definite  matrix  for  each  xe  O,  b is  a vector,  and  the 

p — 

functions  a^^,  b^,  c,  p are  functions  of  class  C (o)  with  p > 0 
in  O.  In  Theorem  1 we  establish  that  X*  satisfies 


(2)  ).*  » rain  , raax  \ / i +ci>® + W bdx 

VaC^o)lo 


- [(2a)"^  - V^]'^(2a)[C2a)-^- V^U^dx 

n ' 


P _ p 

where  4)  is  the  set  of  functions  (})  of  class  C (o)  nC(o)  with  > 0 

in  n and  -1.  If  b - 0 the  operator  defined  by  (l)  is  self- 

O 

adjoint  and  (2)  reduces  to  Rayleigh-Ritz.  If  not,  then  the 
expression  (2)  can  be  considered  as  a generalized  Raylelgh-Rltz 
expression. 
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Recently,  using  different  methods,  Donsker-Varadhan  [1] 
have  derived  a similar  expression  in  the  case  of  zero  Dirichlet 
boundary  conditions  and  p = 1.  In  Section  3 we  outline  our 
approach  to  the  Dirichlet  case. 

Finally,  in  Section  4 we  made  some  remarks  concerning  a 
possible  numerical  scheme  for  computing  approximations  to  and 
the  corresponding  normalized  eigenfunction  u*.  This  scheme  does 
not  use  (2),  but  instead  involves  the  solution  of  a set  of 
nonlinear  difference  equations.  These  equations  result  from  a 
discretization  of  equation  (5)  below.  The  difference  equations 
are  then  related  to  a stationary  stochastic  control  problem. 
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2.  Natural  boundary  conditions 

THEOREM  1.  Assume,  in  addition  to  the  above,  that  the  functions 
aij,  b^,  c are  of  class  C (n)  and  that  O Is  a domain  of  class  C . 
Then  (2)  is  true. 

Proof:  Equation  (l)  can  be  written  in  the  form 


(-3) 


- trace  au  + u (b+d) + cu  = Apu 


for  an  appropriate  vector  function  d.  As  a consequence  of  the 

Krein-Rutman  theory  of  positive  operators  and  the  majctmum  principle, 

we  let  u*  denote  an  eigenfunction  corresponding  to  the  principal 

eigenvalue  "K*  such  that  u*  > 0 in  O and  p(x)u*(x)^dx  = 1.  We  now 

O 

msLke  the  change  of  variables  u*  = exp  (-^)  obtaining 


(^) 


T 

trace  a^xx  " ’^x®'^x  " ^ ^*P  • 


We  have  adopted  the  convention  that  all  vectors  are  column  vectors 
except  gradients  which  are  row  vectors.  We  now  rewrite  (4)  in  the 
form 

(5)  tr  a^  +min  [*  w + (b+d+w)'^(4a)"^(b+d+w)+  c]  = ^*p 

...  ^ 


where  the  min  in  (5)  is  for  each  x taken  over  vectors  w e R*^,  lote 
this  minimum  is  obtained  for 


(6) 

w - -b-d  -2(^^a)'^ 

1 

or 

i 

(7) 

w - -b-d +2(u*)‘^(\;^a)'^  . 

f 

The 

boundary  condition  for  ^ become  ■ 0 on  do. 

j 

4 


% 


Now  let  ■)y^  denote  the  set  of  functions  w of  the  form 
w = -b-d  +2(u)”  some  smooth  positive  function  u in  O 

such  that  n(x)u^(x)dx  = 1.  For  any  w e we  have  the  inequality 
O 

(8)  tr  w+  (b+d+w)'^(4a)“^(b+d+w)  + c > X*p  . 


(9) 


Define  for  each  w e W',  the  operator  L by 


Lp  = V o (p^a)  -V  o((d+w)p)  = 0 . 


Then  the  equation  Lp  = 0 in  O with  the  boundary  condition 


(10) 


[p^a  - p(d+w)'^] ‘n  = 0 on  ^ 


has  a smooth  solution  p which  is  positive  in  O and  satisfies  the 

w 

normalizing  condition  J p(x)p^(x)dx  = 1.  The  existence  of  the 

O 

positive  solution  p follows  from  the  Krein-Rutman  theory  and  the 
maximum  principle.  The  Krein-Rutman  theory  gives  that  the  eigen- 
value equation  Lp  = Xp  with  boundary  condition  (lO)  has  a positive 
solution  in  o when  X is  the  principal  eigenvalue.  Integrating  the 
equality  Lp  = Xp  over  the  domain  O,  one  obtains  that  X = 0 and 
hence  Lp  * 0 has  a positive  solution  in  O.  Positivity  on  the 
boundary  follows  from  (lo)  with  use  of  maximum  principle. 

For  each  w e we  multiply  (8)  by  p^  and  integrate  over  O 
obtaining 

(11)  [ (b+d+w)'^(4a)”^(b+d+w)  + c]  p^dx  > X*  . 

O 

Equality  in  (ll)  holds  only  when  w is  given  by  (7).  Thus  we  have 
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(12)  min  / [ (b+d+w)"^  (4a)”^(b+d+w)  +c]p  dx  = X*  , 

The  proof  of  the  theorem  consists  in  reformulating  (12)  by  dis- 
covering the  relationship  between  w and  p . 

w 

We  break  the  proof  into  three  cases. 


Case  1.  b = 0 (the  self-adjoint  case).  For  any 
— XT  2 

w = (-d  +2(u)"  (u  a)  ) e ‘V,  P is  given  by  u . Simply  check  that 

X w 

2 2 

u satisfies  L(u  ) = 0 and  the  boundary  condition  (lO). 
Substituting  w and  p^  into  (12),  one  obtains  that  (12)  can  be 
rewritten  as 


(13) 


Equation  (13)  is  also  (2),  and  (13)  is  the  standard  Rayleigh-Ritz 
expression. 

Case  2.  (2a)“^b  is  a gradient.  Let  k be  such  that  k„  = (2a)“^b. 

(This  is  the  case  when  the  original  equation  could  have  been  made 
self-adjoint  by  multiplying  the  equation  by  for  an  appropriate 

function  q. ) Now  any  control  w e ^ of  the  form 
w = -b-d  + 2(j)”  (<{>j^a)  can  be  rewritten  as  w e where 

(l4)  vf  = -d  +2u“^(u^a)'^ 


with  u 


for  an  appropriate  consteuit  c. 


Thus  we  need  only 


D 


(15)  \*  = min  / [u  au^+ cu^  +b”^(4a)"^bu^  + uu  bldx 

_ A X X 

ue«  ^ 

which  is  (2)  for  this  case. 

Case  5.  ((2a)“\  is  arbitrary).  We  wish  to  write  each  control 

(16)  w = -b-cH- ^ 

in  the  form 

(17)  w = -d  :’u' ■ I +■  2 

for  smooth  functions  u,  z such  that  u > 0 in  O,  jT  p(x)u^(x)dx  = 1, 

2 ^ 
and  p = u where  p is  the  solution  to  Lp  = 0 with  boundary 
w w w 

rp 

condition  (lO).  Moreover  we  require  that  z = -b+2(W  a)  for  some 

A 


-w 


function  W.  Let  us  show  that  this  is  possible. 

First,  for  any  (J)  given  in  (I6)  we  must  have  that  u = (|)e’ 
From  the  equation  Lp  = 0 with  boundary  condition  (lO)  we  see  that 
u,  z must  satisfy 


(18) 


V o (u  z)  = 0 in  O 
z*n  = 0 on  ^ 


p 

if  p for  w given  by  (17)  is  to  be  p = u . Using  the  condition 
w w 

I -W 

u = (Jie  we  obtain  the  equation 

(19)  V o ((J>^e"^'^(-b +2(W^a)'^)  = 0 in  O 

with  boundary  condition 

(-b'^  + 2(W  a))*n  = 0 on  do 

A 


(20) 
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which  must  oe  solved  for  V/  for  each  (j).  The  equations  (19),  (20) 
have  a solution  provided  the  equations 


(21) 


V e (t|)^Gb  +({)^(G^a)'^)  = 0 in  O , 
(-({)^Gb'^  + (|.^G^a).n  = 0 on  hD 

X 


have  a positive  solution  G.  The  solution  of  (19),  (20)  is  obtained 

OT  T 

from  (21)  through  the  substitution  G = e~  . Now  (21)  has  a positive 
solution  by  a repetition  of  the  earlier  argument  concerning  the 
existence  of  a positive  solution  to  Lp  = 0 with  boundary  condition 
(10)  . 


Thus  every  control  of  the  form  (l6)  can  be  written  in  the 

form 

w = -d  + 2u"^u  a)'^+  (-b+  2(W^a)'^) 
and  u,  W satisfy 

V o (u^(-b  + 2(W^af)  =0  in  O , 

(-b"^  + 2(W^a) ) .n  = 0 on  So  . 

evaluating  the  cost  of  using  controls  of  the  form  (22), 
to  observe  the  following.  For  any  smooth  u > 0 in  O 
problem  of  minimizing 

(24)  I(V)  = / ((2a)-^)- V^)'^(2a)((2a)'^b- vj)u^dx 

O 

over  the  class  of  smooth  functions  V.  Then  W given  by  (23) 
minimizes  (24)  and  moreover 


(22) 

2 

with  P„  = u 

(23) 

Before 
(23)  we  need 
consider  the 
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(25)  J Qx(-b+  2(W^a)'^)u^dx  = 0 

O 

for  any  smooth  function  Q.  The  proof  of  (24),  (25)  is  a simple 
exercise  in  the  calculus  of  variations.  We  will  use  (25)  below 
when  Q = £n  u and  Q = W. 

Let  us  now  use  a control  of  the  form  (22).  Then  the  left 
hand  side  of  (ll)  can  be  written  as  the  sum  of  four  terras 

(26)  / [^  au'^  + cu^  + b'^(4a)“^u^  + uu  b]  dx 

^ X X y 

O 

+ [ (-2a)“^b  + W^]'^a[  (-2a)”H  + W^]u^dx 

O 

+ J'  {v  In  u)  (-b  + 2(W^a)'^)u^dx 

O 

+ y' b'^(2a)“^(-b  + 2(w^a)'^)u^dx  . 

O 

The  third  term  is  zero  by  virtue  of  (25)  • Using  (25)  we  can  add 

0 = y" -Wj^(-b+ 2(W^a)'^)u^dx 

to  the  fourth  term  to  obtain  -2  times  the  second  integral  in  (26). 
Therefore  the  sum  of  the  second,  third  and  fourth  integrals  can 
be  written  as 

(27)  -^f  [(2a)-^b  -w'^]'^(2a)[(2a)-^b-W^]u^dx  . 

O 

Using  the  definition  of  the  minimum  problem  for  l(V)  and  the  fact 
that  W minimizes  l(V),  one  can  rewrite  (27)  as 
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(28)  max  -^J  [ (2a)"^b  - V^] '^(2a)  [ (2a)"^b  - V^]  u^dx  . 

V€G^(o)  O 

Substituting  this  into  (26)  completes  the  proof  of  the  theorem. 

Remarks . Although  we  have  given  a proof  that  avoids  the  explicit 
use  of  probabilistic  ideas,  we  were  motivated  by  probabilistic 
concerns.  Take  p = 1,  then  (6)  with  the  boundary  condition 
’^,.'i.n  = 0 Is  the  "verification  equation"  for  a stationary/  stochastic 
control  pioblem.  With  each  Lipschitz  function  w associate  the 
Ito  stochastic  differential  equation 

(29)  di  = w(Odt+/2  a(Odb(t)  , = a , 

b = brownian  motion,  with  reflection  in  the  interior  of  O in  the 
direction  -an  where  n is  the  outer  normal.  Then  p^  given  by  (9), 
(10)  is  the  invariant  density  of  the  process..  Associate  with  each 
"control"  w the  cost 

(50)  C(w)  = [ (b+d+w )'^(4a)''^(b+d+w ) + c] p^dx  . 

O 


Using  equation  (5)  and  the  Ito  stochastic  differential  rule  one 
obtains  that  the  minimum  of  C(w)  over  Lipschitz  control  function 
is  given  by  A*.  Using  the  approach  one  can  derive  the  alternative 
representation  (recall  p = l) 


(31)  A*  = min  min 


1 f + C(|)^  + (|)(|)^b+ b'^(4a)~\({)^]dx 


zec  (o)nc(o) 

Vo  ((|)^z  )=0  in  O 
z»n  =0  on  an 


+ y' [ (z'^(4a)"^z  +z'^(2a)“H)(j)^+  (j»(J)^z]dxl  . 
O •' 


V 


A 
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5 . Dlrichlet  boundary  conditions 

As  we  have  previously  reinarke'i,  Donsker-Varadhan  [1]  have 
considered  this  case  when  p = 1.  Therefore  let  us  only  outline 
how  our  approach  proceeds  for  the  general  Dirichlet  case  with 
smooth  p > 0 arbitrary  to  yield  the  conclusion  (4o)  below.  Let 
us  assume  in  this  section  that  the  coefficients  a. b.,  c are  of 
class  C°°(o).  We  shall  note  below  where  we  use  this  assumption. 

We  again  make  the  change  of  variables  u*  = obtaining  equations 
(5)  - (8)*  However,  now  the  boundary  condition  is 
^(x)  = -In  u*(x)  -*+00  as  x -*•  9o.  This  fact  causes  the  Dirichlet 
case  to  be  somewhat  more  difficult  and  necessitates  a slightly 
different  approach  than  in  the  proof  of  Theorem  1. 

Let  (|)  be  any  positive  function  in  O such  that 

(52)  ({)^(x)/d(x)  -►  0 as  x -♦  So  , 


where  d(x)  is  the  distance  of  x to  So,  and  J p(x)(j)^(x)dx  = 1.  For 
such  <|)  let  z be  any  smooth  function  such  that  V * (<j)^z)  = 0 in  O 
and  let 


(35) 


w = -d  + 2(|)“^(())  a)"^  + z . 


For  such  w,  p = satisfies  Lp  =0  with  the  boundary  condition 

W 

p = 0 on  So.  The  operator  L is  the  same  as  in  the  proof  of 
w 

Theorem  1. 

Multiplying  (5)  by  p and  integrating  by  parts  one  obtains 

W 
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(3^)  f i a(j)^  + C'l'^  + ({)(J)  b + b'^(4a)“^b({)^dx 

\J  ^ ^ X 

O 

+ J'  z'^(4a)~^z(j)^  + 2'^(2a)”^b({)^  + (|)(j)^zdx  _>  >v*  . 

O 

Condition  (32)  has  been  used  to  eliminate  certain  terms  when 
integrating  by  parts. 

T 

For  each  (j)  we  choose  z = -b4-2(W  a)  where  W minimizes  l(V) 
and  l(V)  is  as  in  the  proof  of  Theorem  1.  A simple  exercise  shows 
that 

div  ((}>^z)  = 0 

and 

J Q^(-b  +2(W^a)'^)(j)2dx  = 0 

for  any  smooth  Q.  Therefore  we  can  rewrite  (54)  in  the  form 
(35)  inin  maLX  | / acj)^  + C(()^+  ijxj)  b + b'^(4a)~^b(j)^]dx 

^^^VeC^O)lo 

■ ?/  [(-2a)"H+ V^]'^(2a)[(-2a)-^b+V^](}>^dx|  > A*  , 

p 

where  <I>  is  the  set  of  (})  such  that  (j)  > 0 in  O,  (|)  /d  -♦  0 as  x -*• 

and  p(x)<|i^(x)dx  = 1. 

O 

To  complete  our  representation  we  wish  to  show  that  equality 
is  obtained  in  (55)  for  some  We  wish  to  show  that 

(56)  -d-b +2(u*)"^(u*a)^  = -d+ 24)"^((l)^a)'^+  (-b  + 2(W^a)'’^) 

with  ({)£  4)  and  W minimizes  l(V).  As  in  the  proof  of  Theorem  1 we 
see  that  (|»,  W must  satisfy  (}i  * u*e“'^.  Since  u*  satisfies  (l)  with 
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u > 0 in  O,  u*  = 0 on  SO,  then  u*  0 on  So  and  consequently 
there  exists  positive  constants  c^^,  c^  such  that 
Cj^d(x)  < u*(x)  < C2d(x).  Thus  (u*)^/d-*-0  as  x -*•  ^n.  Hence  if 
(|)  = u*e”^,  then  (J>^/d  -►  0 as  x -*hO  and  moreover  > 0 in  O. 

Now  (j)^,  W must  also  satisfy  the  equation 

(57)  V ^ (<})^(-b + 2(W^a)'^)  = 0 , 
hence  we  must  have 

(58)  Vo  ((u*)^e“^^(-b  + 2(W^a)'^))  = 0 . 

Thus  if  the  equation 

(59)  V o ((u*)^(-bG+  (G^a)'^)  = 0 

has  a positive  solution  G in  O,  then  the  change  of  variables 
G = e"^'^  defines  a solution  W to  (58).  If  we  can  find  the  solution 
W,  then  we  can  employ  equation  (36).  This  gives  us  equality  in 
(5)  and  hence  (35)*  Therefore  we  would  have  the  desired  result 

(4o)  A*  = min  max  j / <|>„a(})3  + c(|)^  + (jxj)  b + b'^(4a)"^b(j)^dx 

Vcc"(o)lo 

- [(-2a)"H)+ V^]'^(2a)[(-2a)'^b+ V^](|)^dx|  . 

O 

Thus  it  remains  to  establish  the  existence  of  a positive 
solution  G in  O to  (39  )•  No  boundary  conditions  are  imposed 
with  (39);  this  is  to  be  expected  since  (u  ) vanishes  on  hO, 


Because  of  this  last  fact  we  employ  a different  approach  to 
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establish  the  existence  of  W.  For  this  we  shall  utilize  the 
C^(n)  smoothness  of  a.  b.,  c although  this  assumption  could 

IJ  1 

possibly  be  weakened. 

Consider  the  Ito  stochastic  differential  equation 
(4l)  d^  = 2u*(u*a)'^+  (u*)^(b+K)dt  +/2  u*odb 


T ^ h 

where  oa  = a,  K.  = ) -v—  (a  . ),  with  arbitrary  initial  data 
^^(o)  = X e O.  We  wish  to  show  that  equation  (4l)  generates  a 
unique  ergodic  measure  in  O with  probability  density  of  class 

(o)  given  by  G.  To  do  this  we  use  some  results  of  Khasrainski  [3] 
Consider  a connected  domain  D c o such  that  SD  =>  and  if 
X e D then  0 < u*(x)  < l/2.  Then  for  h sufficiently  large  the 
function  T(x)  = -h  ^n  u*(x)  satisfies  in  D the  inequality 


trace  (u*  )^aT^  + T^[  (u*  )^(b+K)  + 2(u*  ) (uja)'^]  + 1 < 0 . 


From  standard  results  on  Ito  equations  this  implies  that  the 
process  Ijj(t)  with  initial  condition  x in  D never  reaches  So  and 
moreover  hits  SD  - So  in  finite  mean  time.  Since  the  coefficient 
0 does  not  vanish  in  O,  then  results  of  Khasminski  imply  the 
existence  of  a unique  finite  ergodic  measure.  Equation  (59)  is 
the  equation  governing  the  density  of  the  ergodic  measure.  Since 

o o 

the  coefficient  matrix  (u*)  a appearing  in  the  trace 
term  in  (39)  is  positive  definite  in  Q,  then  the  invariant  measure 
has  a positive  density  cG  in  O,  for  an  appropriate  constant  c, 
of  class  C°°(o)»  See  [2],  p.  248.  This  last  fact  utilizes  the 


1 


I 


1 


ih 

smoothness  assumptions  on  the  coefficients  c.  Hence 

there  is  a positive  solution  G and  the  outline  of  the  derivation 
of  (ho)  is  concluded. 

For  the  Donsker-Varadhan  analogue  of  (4o)  in  the  Dirichlet 
case  with  p = 1,  see  equation  (3.7)  in  [1]  and  note  that  a/2 
instead  of  a is  used  in  their  version  of  (l). 
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^ . Numerical  methods 

Lot  us  propose  a numerical  method  for  computing  approxima- 
tions to  the  smallest  eigenvalue  X*  and  the  corresponding  eigen- 
function u*  for  the  Neumann  problem  and  also  for  the  periodic 
problem  which  was  not  considered  in  Sections  1-5*  For  details  in 
a simple  case, see  Holland  [6].  The  method  consists  in  applying  a 
finite  difference  approximation  to  the  nonlinear  equation  (5)  and 
the  corresponding  boundary  condition.  If  p = 1,  the  resulting  non- 
linear difference  equations  can  be  given  an  interpretation  as  the 
equations  for  optimal  stationary  control  of  a Markov  chain. 

We  have  employed  a method  due  to  White  for  solution  of  the 
Markov  chain  problem.  White’s  method  was  suggested  by  Kushner  as 
a possible  method,  see  Kushner  [5],  pp.  I56-I57  for  a description 
of  the  method.  Preliminary  results  show  that  this  approach  is 
satisfactory  for  obtaining  A*  and  u*  for  the  periodic  and  Neumann 
problems.  Our  present  numerical  work  includes  periodic  problems 
in  2 spatial  dimensions  and  Neumann  problems  in  1 spatial 
dimension.  Some  preliminary  numerical  work  on  the  Dirichlet 
problem  also  indicates  that  either  the  formal  approximation 
suggested  in  [6]  is  invalid  or  the  rate  of  convergence  ig  so  slow 
that  the  method  is  not  useful. 

We  have  not  yet  justified  the  validity  of  this  discretiza- 
tion process.  Kushner  has  justified  this  approach  for  other 
problems,  see  [4]  for  a summary. 


I 
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